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MULTICAST PROTOCOL WITH REDUCED 
BUFFERING REQUIREMENTS 

FIELD OF THE INVENTION 

The invention relates generally to computer networks and, more particularly, to 
5 networks that support multicast messaging protocols. 

BACKGROUND OF THE INVENTION 

Known reliable multicast protocols typically require that each participant, or 
member, of a group buffer a received multicast message, to allow for retransmission of 
the message. This ensures delivery of the multicast message to all members, even if the 
10 sender of the message ultimately fails. A given member retains a received multicast 
message until the message is "stable," that is, until it becomes known that the message 
has been delivered to every member with at least a relatively high probability. 

The multicast protocols operate in three phases. First, in an initial multicast 
phase, a sender multicasts the message over the group and attempts to provide the 

15 message to as many members as possible. Next, in a repair phase, the members detect 
message losses and request retransmission of the message from the sender or other 
members, as appropriate. Finally, in a garbage collection phase, the members release 
the buffer space assigned to the message once the message becomes stable. Most 
multicast protocols perform the repair and garbage collection phases using a 

20 combination of positive and/or negative acknowledgement messages. 

Known epidemic multicast protocols use gossiping in the repair phase. Each 
member periodically selects another member at random and sends to that member a 
gossip message that includes a list of the messages that the gossiping member has 
retained in its buffer and/or has delivered. The selected member then determines if it 
25 has in its buffer any messages that are not on the list, that is, any messages that are lost 
to the gossiping member. If so, the selected member retransmits the lost messages to 
the gossiping member. Also, the selected member may request that the gossiping 
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member retransmit any messages from the list that the selected member has not yet 
delivered, that is, any messages that are lost to the selected member. The members thus 
perform point-to-point repair. 

The garbage collection phase of the epidemic multicast protocol is typically 
5 performed by having each member release the buffer space allocated to a given 
message a predetermined time after the member delivers the message. The 
predetermined time is based on a prediction of how long it takes to disseminate a lost 
message to the membership through gossiping. Accordingly, the predetermined time 
the message must be retained depends largely on the number of members in the group. 

10 As the number of members in the group increases, the time to both accomplish 

and detect message stability increases. Further, depending on the application, the 
combined rate of sending may also increase as the size of the membership increases. 
Accordingly, each member must buffer more and more messages at any given time, 
which means that each member must maintain and operate larger and larger buffers. 

15 These multicast protocols thus do not scale well. 

SUMMARY OF THE INVENTION 

A scalable multicast protocol includes a mechanism that allows a given 
multicast message to be stored by a subset of the entire group membership. The 

! 

buffered messages are spread over the membership, so that any given member buffers 
20 only a portion of the messages. 

More specifically, a subset of "C" members buffers a multicast message, where 
C is selected to reduce to an acceptable level the probability that a given message will 
be lost before it reaches at least one of the C members. When a member receives a 
multicast message, the member determines whether or not it should buffer the message 

25 by manipulating a string of bytes that is unique to both the message and the member. 
In the exemplary system, the byte string, which consists of a message identifier that is 
included in the message and the member's address, is manipulated in accordance with a 
hash function. As discussed in more detail below, the member buffers the message if 
the result is less than C/n, where n is the number of known members. A member that 

30 buffers a message is hereinafter referred to as a "bufferer" of the message. 
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When one of the C bufferers receives a gossip message that indicates that the 
multicast message has been lost to the gossiping member, the bufferer retransmits the 
message to the gossiping member. When, however, a member that is not one of the C 
bufferers receives such a gossip message, the member determines which members are 
5 bufferers of the lost message and requests that one of the bufferers retransmit the 
message to the gossiping member. 

The selected member identifies the bufferers by manipulating the message 
identifier associated with the lost message and the respective addresses of the members 
known to the selected member. The selected member then picks one of the identified 

10 bufferers at random, and sends to it a request for retransmission that identifies the 

message and specifies the gossiping member as the destination address. The bufferer 
that receives the request then retransmits the lost message to the gossiping member, 
assuming that the selected bufferer has not already released the buffer space allocated 
to the message. The members then continue to gossip and the lost message should, 

is with very high probability, be supplied to all of the members by the bufferers through 
this process. 

The system trades off reduced buffer space at each member against an increase 
in traffic due to the sending of requests for retransmission. In a system with a low 
probability of lost messages, there is a relatively small increase in the associated traffic, 
20 and a rather significant reduction in required buffer space at each member. Further, as 
the size of the membership increases, the size of the buffer decreases since the number 
of members that buffers a given message, C, is essentially fixed. 

The multicast protocol may further include a mechanism to detect, in the initial 
phase of the multicast operation, "catastrophic failures" in which none or few of the 

25 members receive a multicast message. Each member includes the buffer discussed 

above and a relatively small, fixed-size "short-term" buffer that holds a limited number 
of the received messages in the order in which the messages are received. A member 
monitors any holes or gaps in the sequences of incoming messages, and detects a 
catastrophic failure when a received gossip message identifies one of the same holes or 

30 gaps, as discussed in more detail below. 
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When such a failure is detected, the member sends a request for multicast 
retransmission of the associated missing message to the sender, and the sender again 
multicasts the message to the group. If a catastrophic failure has occurred, the 
multicast retransmission request is sent relatively soon after the initial transmission, and 
5 thus, the request for multicast retransmission can be handled from the sender's short 
term buffer. If the initial multicast transmission did not involve a catastrophic failure, 
the point-to-point repair is handled in the manner discussed above. 

BRIEF DESCRIPTION OF THE DRAWINGS 

The invention description below refers to the accompanying drawings, of 

10 which: 

c 

Fig. 1 is a functional block diagram of a system that operates in accordance with 
the invention; 

Fig. 2 is a flow chart of the multicast buffering operations of the system of Fig. 

l; 

15 Fig. 3 is a flow chart of the operations of the system of Fig. 1 during the repair 

phase of the multicast protocol; 

Fig. 4 is a flow chart of a manipulation operation performed during the 
operations of Fig. 3; 

Fig. 5 is a functional block diagram of a system that detects catastrophic failures 
20 in the initial multicast phase; and 

Fig. 6 is a flow chart of the failure detection operations of the system of Fig. 5. 

DETAILED DESCRIPTION OF AN ILLUSTRATIVE 

EMBODIMENT 

Referring to Fig. 1 , the system includes one or more groups 1 0, with the 
25 drawing depicting a single group. The group includes a plurality of members 12 that 
communicate with one another over communications paths 1 4, by sending messages 
point-to-point, gossiping and multicasting messages over the group. 

To facilitate communication, each member maintains a list 1 6 of the addresses 
of the other members. The list maintained by a given member includes the addresses of 
30 those members that are known to the given member through, for example, gossiping. 
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Accordingly, the list maintained by one member may at times differ from the list 
maintained by another member. The lists, however, will generally overlap to a large 
extent. 

The members 12 use a multicast protocol which requires that only a subset of 
5 "C" members buffer a given message. As discussed in more detail below, the messages 
are spread out over the group, so that a given member buffers only a portion of the 
multicast messages in a buffer 18. A member that buffers a given message is referred 
to hereinafter as a "bufferer" of the message. 

Referring also to Fig. 2, each multicast message includes a unique identifier that 
10 in the exemplary system consists of the source, or sender's, address and a message 
sequence number. As is known to those skilled in the art, each member of a group is 
assigned an address that is unique over at least the group. 

When a member receives a multicast message, the member determines if it 
should buffer the message by manipulating a string of bytes that is unique to both the 
15 message and the receiving member (steps 200). In the exemplary system, the receiving 
member manipulates a string of bytes consisting of its own address and the message 
identifier that is included in the message. If the result is less than C/n, where n is the 
number of members known to the receiving member, the receiving member both 

* i i 

buffers and delivers the message (steps 202, 204). Otherwise, the receiving member 
20 delivers but does not buffer the message (steps 202, 203). 

Referring also to Fig. 3, the members periodically gossip about the multicast 
messages they have delivered. A member thus periodically selects another member at 
random and sends to the selected member a gossip message that includes a list of 
delivered multicast messages. The selected member then determines if it has delivered 
25 a message that has not been delivered by the gossiping member, that is, if any multicast 
messages have been lost to the gossiping member (step 300). 

If a lost message is detected and the selected member is a bufferer of that 
message, the selected member retransmits the message to the gossiping member (steps 
302, 303). Otherwise, the selected member identifies the bufferers of the message from 
30 the list of members known to the selected member (step 304). The selected member 
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thus manipulates byte strings that consist of the message identifier and the respective 
addresses of the known members, and identifies as bufferers those members associated 
with results that are less than C/n. The selected member then picks one of the 
identified bufferers at random and sends to it a request for retransmission that identifies 
5 the lost message and specifies the gossiping member as the destination address (step 
306). If the bufferer has the message in its buffer when it receives the request for 
retransmission, the bufferer retransmits the message to the gossiping member. 
Otherwise, the bufferer ignores the request. 

If the lost message is not then retransmitted to the gossiping member by the 
lo bufferer, the process is repeated when the gossiping member sends its next gossip 
message. 

The number, C, of bufferers is selected based on the probability of message loss 
for the group. The probability of message loss is calculated in a conventional manner 
and depends largely on the topology of the group and only somewhat on the number of 
is members in the group. The number C is then selected such that the probability that the 
message fails to reach at least one bufferer is acceptably low. 

The probability of message loss does not change significantly as members are 
added to the group. Accordingly, the value of C/n decreases as the number of 
members, n, increases. The members will thus be required to individually buffer fewer 
20 and fewer messages as the membership grows, and the C buffered messages are spread 
out over the larger group. 

The way in which a member determines if it is a bufferer for a given message 
should be fair, in the sense that the results of the manipulation of different byte 
sequences should be unrelated. This ensures that approximately C members will be 

25 bufferers for a given message, and that the bufferers for all the messages will be spread 
over the group. The manipulation, which is performed for every received multicast 
message and when messages are lost, should also consume relatively little of the 
member's processing resources. A cryptographic hash function is fair, but is generally 
too processor intensive. Alternatively, a cyclic redundancy check uses little processing 

30 time, but is generally predictable, and thus, not fair. 
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In the exemplary system, a hash function that is based on a "shuffle table" is 
used. The shuffle table is a table of X randomly chosen integers that is entered once for 
each byte of the byte string. In the exemplary system the shuffle table contains 256 
entries. 

5 Referring now to Fig. 4, at the start of the manipulation, the hash value is set to 

zero (step 400). Next, the first byte of the byte sequence is XOR'd with the last 
significant byte of the hash value. The result is then used to enter the shuffle table 
(steps 402, 404). The hash function next XORs the selected table entry and the hash 
value, to produce an updated hash value (step 406). The next byte of the byte string is 

10 then XOR'd with the least significant byte of the updated hash value, and the table is 
again entered with the result. The selected table entry is XOR'd to the updated hash 
value, to produce a next updated hash value, and so forth, until all the bytes of the 
string have been manipulated (steps 406, 408, 41 0). The updated hash value, which is 
essentially a random sequence of "b" bits, is next divided by the integer 2 n to produce a 

is final hash value that is between zero and one (step 409). The hash function is relatively 
fair, since the final hash values for different byte strings are unrelated due to the 
inclusion of the shuffle table entries. Also, the hash function is not processor intensive, 

i 

since it involves performing only XOR operations and entering a single, relatively 
small, lookup table. 

20 The same hash function is used during the repair phase when a member 

determines which members are bufferers for a given message. Each byte string 
involved includes the message identifier and an address of one of the other known 
members. The intermediate hash value produced after manipulation of the message 
identifier is the same for each of these byte strings. Accordingly, the selected member 

25 may use this intermediate hash value and further manipulate the bytes of the various 
member addresses, to produce the associated final hash values associated with the list 
of members. The selected member then compares the final hash values with C/n, to 
determine which of the known members are bufferers, as discussed above. 

Referring now to Figs. 5 and 6, the system may include a mechanism to detect, 
30 during the initial multicast phase "catastrophic failures" in which none or few of the 
members receive the message. Each member thus includes, in addition to the buffer 1 8 
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discussed above with reference to Figs. 1-4, a "short term" buffer 20 that holds a 
limited number of received multicast messages in the order in which the messages are 
received. The short term buffer 20 holds each received message for a relatively short 
time for catastrophic failure recovery, while the buffer 1 8 holds a portion of the 
5 received messages for the longer time associated with point-to-point repair. The size of 
the short term buffer is independent of group size, and depends instead on the overall 
rate of message transmission. 

During the initial multicast phase, each member holds in the short term buffer 
20 every multicast message it receives, in the order in which the messages are received 

10 (step 600). If the short term buffer is full when a next message is received, the member 
overwrites the earliest buffered message. The member also determines if it is a bufferer 
of the received message, and stores the message in the buffer 1 8 accordingly. Each 
member further detects "holes" or gaps in the message sequence numbers of the 
incoming messages (step 602). The members then include information about the gaps 

15 in the gossip messages that they send to randomly selected members. When a selected 
member receives a gossip message that identifies one of the holes that was also 
detected by the selected member, the member sends a multicast retransmission request 
to the sender (steps 604, 606). In response, the sender multicasts the message from its 
short term buffer to the entire group. 

20 If a catastrophic failure has occurred, there is a relatively high probability that 

the selected members and the gossiping members will readily detect the same hole. 
The failure will thus be detected relatively quickly after the initial multicast 
transmission, and presumably be corrected when the sender resends the multicast 
message from its short term buffer. The associated point-to-point repair will thus be 

25 minimized. Further, the early detection and correction of the failure ensures that the 
underlying assumptions associated with a relatively low probability of message loss 
will be met, and thus, that the message will in all likelihood be received by at least one 
of the C bufferers as part of the initial phase multicast transmission. 

If the multicast transmission did not involve a catastrophic failure, the multicast 
30 message will have been received by most members. There is thus a relatively low 

probability that the gossip messages will identify a hole in a message sequence that are 
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also detected by the randomly selected recipients of the gossip messages. Accordingly, 
the original sender is not likely to receive a multicast retransmission request if a failure 
has not occurred. If a failure has occurred, it should be corrected relatively quickly in 
comparison to the dissemination of gossiped information. Accordingly, the sender 
5 should not be inundated with multicast retransmission requests. 

The foregoing description has been limited to a specific embodiment of this 
invention. It will be apparent, however, that variations and modifications may be made 
to the invention, such as using the multicast protocol over a subgroup, with the 
attainment of some or all of its advantages. Therefore, it is the object of the appended 
10 claims to cover all such variations and modifications as come within the true spirit and 
scope of the invention. 

What is claimed is: 
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CLAIMS 

1 1 . A method of multicasting messages over a group of members in a network, the 

2 method including the steps of: 

3 A. multicasting the message over the group; 

4 B. determining, at one or more of the members receiving the message, if 

5 the one or more members are bufferers of the message; 

6 C. at the one or more members that are bufferers of the message, buffering 

7 and delivering the message; 

8 D. at the one or more members that are not bufferers of the message, 

9 delivering the message. 

1 2. The method of claim 1 wherein the step of determining which members are the 

2 bufferers includes the steps of: 

3 i. at each of the one or more members, manipulating a string of bytes that 

4 is unique to both the message and the member, 

5 ii. determining if the result of the manipulation is less than a value 

6 calculated by the member. 

1 3. The method of claim 2 wherein the step of manipulating the string of bytes includes 

2 manipulating the bytes in accordance with a hash function. 

1 4. The method of claim 3 wherein the hash function includes the steps of 

2 a. XOR'ing the respective bytes of the byte string with a hash value; 

3 b. entering a stored table with the results of step a and selecting a table 

4 entry; 

5 c. XOR'ing the selected table entry with the hash value to update the hash 

6 value; 

7 d. repeating steps a-c for all of the bytes in the byte string, and 

8 e. dividing the result by a predetermined integer to produce a final hash 

9 value as the result. 
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1 5. The method of claim 4 wherein the step of determining if the result of the 

2 manipulation is less than a value calculated by the member includes using as the 

3 calculated value C/n, where C is selected based on the probability of a lost message and 

4 n is the number of group members that are known to the member. 

1 6. The method of claim 1 further including the steps of 

2 E. selecting a member at random and sending to the selected member a 

3 gossip message that includes a list of messages delivered by a gossiping 

4 member; 

5 F. determining at the selected member if a message is lost to the gossiping 

6 member; 

7 G. for a lost message, retransmitting the message from the selected member 

8 to the gossiping member if the selected member is a bufferer of the lost 

9 message; 

10 H. if the selected member is not a bufferer of the lost message, determining 

11 at the selected member which members are bufferers of the lost message 

12 and sending to one of the bufferers a request for retransmission of the 

13 lost message to the gossiping member. 

1 7. The method of claim 6 further including in the steps of determining if a given 

2 member is a bufferer of a given message and determining which members are 

3 bufferers of the given message the steps of 

4 i. manipulating a string of bytes that is unique to the message and a given 

5 member, 

6 ii. determining if the result of the manipulation is less than a calculated 

7 value C/n, where C is selected based on the probability of a lost message 

8 and n is a number of known group members. 



WO 01/61928 



PCT/USO 1/04468 



-12- 



1 8. The method of claim 7 wherein the step of manipulating the string of bytes includes 

2 manipulating the bytes in accordance with a hash function. 

1 9. The method of claim 8 wherein the hash function includes the steps of 

2 a, XOR'ing the respective bytes of the byte string with a hash value; 

3 b. entering a stored table with the results of step a and selecting a table 

4 entry; 

5 c. XOR'ing the selected table entry with the hash value to update the hash 

6 value; 

7 d. repeating steps a-c for all of the bytes in the byte string; and 

8 e. dividing the result by a predetermined integer to produce a final hash 

9 value as the result. 

1 10. The method of claim 1 further including the steps of 

2 E. at one or more members storing received multicast messages in 

3 relatively small short term buffers; 

4 F. at a given member detecting a gap in a sequence of the received 

5 messages; 

6 G. including in a gossip message information that identifies the detected 

7 gaps; 

8 H. if a received gossip message identifies a gap that is also detected by the 

9 member that received the gossip message, sending to the source of the 

10 associated message sequence a request for a multicast retransmission of 

i 

n the message that corresponds to the detected gap; and 

12 I. at the source, multicasting the message over the group from the short 

13 term buffer. 

1 11. The method of claim 1 0 wherein the size of the short term buffer is based on the 

2 rate of multicast message transmission for the group. 
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1 12. The method of claim 1 0 wherein the step of determining if the one or more 

2 members are bufferers of the message includes the steps of: 

3 L at each of the one or more members, manipulating a string of bytes that 

4 is unique to both the message and the member, 

5 ii. determining if the result of the manipulation is less than a value 

6 calculated by the member. 

1 13. The method of claim 12 wherein the step of manipulating the string of bytes 

2 includes manipulating the bytes in accordance with a hash function. 

1 14. The method of claim 13 wherein the hash function includes the steps of 

2 a. XOR'ing the respective bytes of the byte string with a hash value; 

3 b. entering a stored table with the results of step a and selecting a table 

4 entry; 

5 c. XOR'ing the selected table entry with the hash value to update the hash 

6 value; 

7 d. repeating steps a-c for all of the bytes in the byte string, and 

8 e. dividing the result by a predetermined integer to produce a final hash 

9 value as the result. 

1 15. The method of claim 14 wherein the step of determining if the result of the 

2 manipulation is less than a value calculated by the member includes using as the 

3 calculated value C/n 5 where C is selected based on the probability of a lost message and 

4 n is the number of group members that are known to the member. 

1 16. The method of claim 10 further including the steps of 

2 J. selecting a member at random and sending to the selected member a 

3 gossip message that includes a list of messages delivered by a gossiping 

4 member; 
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5 K. determining at the selected member if a message is lost to the gossiping 

6 member; 

7 L. for a lost message, retransmitting the message from the selected member 
s to the gossiping member if the selected member is a bufferer of the lost 

9 message; 

10 M. if the selected member is not a bufferer of the lost message, determining 
i i at the selected member which members are bufferers of the lost message 

12 and sending to one of the bufferers a request for retransmission of the 

13 lost message to the gossiping member. 

1 17. A system of networked members, each member including: 

2 A. message receivers for receiving messages; 

3 B. a processor for determining if the member is a bufferer of a received 

4 multicast message; 

5 C. a buffer for retaining received multicast messages for which the member 

6 is a bufferer; 

7 D. message delivering subsystems for delivering the received messages; 

8 and 

9 E. a gossiping subsystem for 

10 i. determining from a received gossip message if a multicast 
n message is lost to a gossiping member sending the gossip 

12 message, 

13 ii. if the member is a bufferer of the lost message, retransmitting the 

14 lost message to the gossiping member, 

15 iii. if the member is not a buffer of the lost message, determining 

16 which members are bufferers and sending to one of the buffers a 

17 request to retransmit the lost message to the gossiping member. 



1 18. The system of claim 1 7 wherein the processsor determines if a member is a bufferer 

2 by: 
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3 a. manipulating a string of bytes that is unique to both the message and the 

4 member, and 

5 b. determining if the result of the manipulation is less than a calculated 

6 value. 

1 19. The system of claim 17 wherein manipulating the string of bytes includes 

2 manipulating the bytes in accordance with a hash function. 

1 20. The system of claim 1 9 wherein the processor that uses the hash function includes 

2 a. a first XOR gate for XOR'ing the respective bytes of the byte string with 

3 a hash value; 

4 b. a stored table that is entered with the result produced by the first XOR 

5 gate; 

6 c. a second XOR gate for XOR'ing the selected table entry with the hash 

7 value to update the hash value; and 

8 f. a divider, for dividing by a predetermined value the hash value produced 

9 by the second XOR gate after all of the bytes of the byte string are 

10 submitted to the first XOR gate, to produce the result. 

1 21 . The system of claim 20 wherein the processor determines if the result of the 

2 manipulation is less than a calculated value C/n, where C is selected based on the 

3 probability of a lost message and n is the number of group members that are known to 

4 the processor. 

1 22. The system of claim 17 wherein 

2 a. further including at each member 

3 i. a relatively small short term buffer for retaining received 

4 multicast messages in the order in which the messages are 

5 received; 
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6 ii. means for detecting a gap in a sequence of the received 

7 messages; and 

s b. the gossiping subsystem further 

9 i. includes in a gossip message information that identifies the 

10 detected gaps, and 

1 1 ii. if a received gossip message includes information about a gap 

12 that is also detected by the member that received the gossip 

13 message, sending to a source of the messages associated with the 

14 gap a multicast retransmission request. 

1 23 . The system of claim 22 wherein the size of the short term buffer is based on the rate 

2 of multicast message transmission for the members. 
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203 

d 



THE MEMBER DELIVERS 
BUT DOES NOT BUFFER 
THE MESSAGE 



NO^ 



A MEMBER RECEIVES 
A MULTICAST MESSAGE 



THE MEMBER MANIPULATES 
A BYTE STRING THAT IS 
UNIQUE TO THE MESSAGE 
AND THE MEMBER 



IS THE RESULT LESS THAN 
A VALUE C/n ? 



YES 



THE MEMBER BUFFERS AND 
DELIVERS THE MESSAGE 



200 



202 




204 



FIG. 2 
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303 



RETRANSMIT THE LOST 
MESSAGE TO THE 
GOSSIPING MEMBER 



YES- 



300 



THE MEMBER DETECTS THAT 
A MESSAGE WAS LOST TO 
THE GOSSIPING MEMBER 



302 



IS THE LOST MESSAGE 
BUFFERED BY THE MEMBER? 




NO 



304 



MANIPULATE THE MESSAGE 
IDENTIFIER OF THE LOST 
MESSAGE AND THE ADDRESSES 
OF THE OTHER MEMBERS 
KNOWN TO THE MEMBER TO 
DETERMINE WHICH MEMBERS 
ARE BUFFERERS 



306 



PICK ONE OF THE BUFFERERS 
AT RANDOM AND SEND TO THE 
BUFFERER A REQUEST FOR 
RETRANSMISSION OF THE 
LOST MESSAGE TO THE 
GOSSIPING MEMBER 



FIG. 3 



r 
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400 



SET HASH VALUE TO 
ZERO 




402 



XOR A FIRST BYTE OF A BYTE 
STRING AND THE HASH VALUE 




404 



ENTER A SHUFFLE TABLE 
WITH THE RESULT TO SELECT 
A TABLE ENTRY 



409 



DIVIDE THE UPDATED 
HASH VALUE BY THE 
LARGEST ENTRY IN THE 
TABLE TO PRODUCE A 
FINAL HASH VALUE 



NOH 



XOR THE SELECTED TABLE 
ENTRY TO THE HASH VALUE 
TO PRODUCE AN UPDATED 
HASH VALUE 



IS THERE ANOTHER BYTE IN 
THE BYTE STRING? 



YES 



XOR A NEXT BYTE OF THE 
BYTE STRING AND THE 
UPDATED HASH VALUE 




406 



408 




410 




FIG. 4 
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THE MEMBER STORES 
RECEIVED MESSAGES IN 
ORDER IN A SHORT TERM 
BUFFER 



600 



605 



CONTINUE 
POINT-TO-POINT 
REPAIR 



NO- 



602 



THE MEMBER DETECTS A GAP 
IN A SEQUENCE OF MESSAGES 




604 



IS THE SAME GAP IDENTIFIED IN 
A RECEIVED GOSSIP MESSAGE? 




YES 



606 



SEND A MULTICAST 
RETRANSMISSION REQUEST 

TO THE SENDER OF THE 
SEQUENCE OF MESSAGES IN 

WHICH THE GAP OCCURS 



FIG. 6 



